INFOSM2^TION PROCESSING APPARATUS OPERATING 
IN TOUCH PANEL MODE AND POINTING DEVICE MODE 

FIELD OF THE INVENTION 
5 [0001] The present invention relates to an 

information processing apparatus with a touch panel, and 
more particularly to an information processing apparatus 
with a touch panel having different input modes of 
operation . 

10 BACKGROUND OF THE INVENTION 

[0002] In an information processing apparatus having 

a touch panel and a display, when a user performs an input 
operation on the touch panel, a position pointed to on the 
touch panel must be aligned with the position of a 

15 corresponding indication on the display. The recent 
higher definition or resolution display requires a higher 
resolution touch panel. Such a higher resolution touch 
panel requires more accurate operation of pointing to an 
indication of a desired position on the display. However, 

20 the pointing operation with a finger produces an 
inaccurate pointing to the desired position. Thus it is 
imperative to use a stylus pen with a sharp distal end. 
[0003] However, even when a stylus pen is used on a 

higher resolution display of a small-sized terminal, there 

25 still is the problem that it is difficult to point 
accurately to very small buttons and other items on a 
display screen. On the other hand, when a separate 
pointing device such as a mouse is used, the volume or 
size of such a pointing device itself becomes an obstacle 

30 to reduce the size of the information processing 
apparatus . 

[0004] T. Sasaki in Japanese Patent Publication JP-A- 

HEI 8-221204 published on August 30, 1996 discloses an 
apparatus, in which a touch panel is placed over a 
35 display, and in which the coordinates of a position 
pressed on the display are detected, and an indicator on a 
mouse emulation section, while being held pressed, is 
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moved in any desired direction to input the locus of the 
movement. Based on the locus of the movement of the 
indicator, a moving amount calculating means calculates 
the amount of the movement, while a moving direction 
5 calculating means calculates the direction of the movement 
based on the locus of the movement of the indicator. A 
moving amount converting means converts the thus 
calculated amount and direction of the movement on the 
mouse emulation section into the amount and direction of 
10 movement for the cursor to be moved on the display 
section, thus causing the cursor to move. 

[0005] O. Fukao in Japanese Patent Publication JP-A- 

HEI 7-72976 published on March 17, 1995, discloses a 
system, in which an area for recognizing an operation 

15 equivalent to a mouse operation is provided on the 
periphery of the effective display area of an LCD. When a 
side region is pointed through a touch panel, the cursor 
is caused to move accordingly based on whether the side 
corresponds to the top, bottom, left or right side, and 

20 similarly, when the region pointed to is a corner region, 
one of a plurality of mouse button operations is 
recognized accordingly based on whether the corner is the 
upper left, upper right or lower left corner, for 
processing for that purpose. 

25 [0006] H. Noto in Japanese Patent Publication JP-A- 

HEI 6-230888 published on August 19, 1994 discloses a 
touch panel for . drawing graphics and writing characters, 
and an information processing apparatus in which a display 
area, where locus data produced by manipulating and 

30 pressing a pen on the touch panel is displayed, can be 
changed as desired. When a peripheral area of the touch 
panel is pointed to, the display area moves accordingly. 

SUMMARY OF THE INVENTION 
[0007] In accordance with an aspect of the present 

35 invention, an information processing apparatus comprises a 
display device and a touch panel disposed in front of the 
display device. The apparatus further comprises: a mode 
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switching unit for switching between a touch panel mode of 
operation and a pointing device mode of operation in 
accordance with a predetermined condition; a touch panel 
processing unit for performing processing in response to a 
5 touch position pointed to by a user on the touch panel in 
the touch panel mode of operation; a pointing processing 
unit for displaying a symbol indicative of a pointing 
position on the display device in the pointing device mode 
of operation, and for moving the symbol at a predetermined 

10 reduction scale factor on the display device in accordance 
with the distance, direction and velocity of the relative 
movement of the touch position pointed to by the user on 
the touch panel; and a display magnification processing 
unit for displaying an image in the neighborhood of the 

15 symbol in a magnified form in a predetermined region on 
the touch panel in the pointing device mode of operation. 
[0008] In accordance with another aspect of the 

invention, the information processing apparatus may 
comprise a touch panel processing unit for displaying a 

20 symbol indicating a pointing position on the display 
device in the touch panel mode of operation so that the 
position of the symbol is aligned with a touch position 
pointed to by a user on the touch panel. 

[0009] The invention also relates to a program for 

25 providing such an information processing apparatus- 

[0010] According to the invention, even in a mobile 

terminal with a small sized display screen, a touch panel 
function advantageously allows pointing to a position in 
higher resolution and a pointing device function 
30 advantageously allows operation of positioning in higher 
resolution. 

[0011] The invention will be described with reference 

to the accompanying drawings. Throughout the drawings, 
similar symbols and numerals indicate similar items and 
35 functions. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0012] FIGURE 1 shows the configuration of a small- 
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sized information processing apparatus having a touch 
panel and a display device^ in accordance with an 
embodiment of the present invention; 

[0013] FIGURES 2A and 2B show different arrangements 

5 of the display device and the transparent touch panel, 
which can be employed in embodiments of the invention; 
[0014] FIGURES 3A and 3B show an embodiment of the 

information processing apparatus in accordance with the 
invention; 

10 [0015] FIGURES 4A and 4B show a further display form 

in a pointing device mode of operation in FIGURE 3B; 
[0016] FIGURE 5 shows a flow chart for determining 

whether an input mode of operation should enter into the 
pointing device mode of operation or the touch panel mode 

15 of operation in response to the manipulation of the stylus 
pen, which is executed by the information processing 
apparatus in accordance with a program; 

[0017] FIGURE 6 shows a detailed flow chart 

illustrating the pointing device mode of operation in 
20 FIGURE 5; 

[0018] FIGURE 7 shows a detailed flow chart 

illustrating the touch panel mode of operation in FIGURE 
5; 

[0019] FIGURE 8 shows another flow chart for 

25 automatically determining whether to operate in the 
pointing device mode of operation or the touch panel mode 
of operation in response . to the manipulation of the stylus 
pen, which is executed by the information processing 
apparatus in accordance with a program; 
30 [0020] FIGURE 9 shows another flow chart which is 

executed by a CPU, simultaneously with the flow chart of 
the pointing device mode of operation of FIGURE 6 
represented by the step in FIGURE 5; 

[0021] FIGURE 10 shows another flow chart which is 

35 executed by the CPU, simultaneously with the flow chart of 
the touch panel mode of operation of FIGURE 7 represented 
by the step in . FIGURE 5; 
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[0022] FIGURES llA and IIB show how an area is moved 

in accordance with the flow chart of FIGURE 9; 
[0023] FIGURE IIC shows how the area is moved in 

accordance with the flow chart of FIGURE 10; 
5 [0024] FIGURE 12 shows an additional subroutine, 

incorporated into the flow chart of the pointing device 
mode of operation of FIGURE 6, for changing the 
magnification scale factor for magnified display within 
the area, which is executed by the CPU, and 

10 [0025] FIGURES 13A and 13B show a circular drag 

operation in the area 214 in connection with FIGURE 12. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
[0026] The inventors have recognized that, in a 

small-sized information processing apparatus with a higher 

15 resolution display device and a higher resolution touch 
panel, it will be advantageous to provide a pointing 
device feature which enables an operation on the touch 
panel to point to a position in higher resolution. 
[0027] An object of the present invention is to 

20 provide an information processing apparatus having a 
display and a touch panel, which enables a operation of 
positioning in higher resolution. 

[0028] FIGURE 1 shows the configuration of a small- 

sized information processing apparatus 100 having a touch 
25 panel and a display device, in accordance with an 
embodiment of the present invention. 

[0029] The information processing apparatus 100 

includes a CPU 102, a ROM 104, a RAM 106, an auxiliary 
memory device 108, a peripheral device interface 110 

30 connected to an input device such as a switch 112, a 
display interface 124, a display device 128, a touch panel 
interface 134, a transparent touch panel 138, an audio 
circuit 144, an audio device 148 including a microphone 
and a speaker, and a LAN card 122 which can be connected 

35 to an external network 20 via a modem 123, all of which 
are interconnected via an internal bus 12 • 

[0030] The CPU 102 performs: a switching operation 
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for switching between a touch panel mode of operation and 
a pointing device mode of operation, as an input mode of 
operation, in accordance with predetermined conditions; a 
touch panel operation in the touch panel mode of operation 
5 for processing in accordance with a touch position pointed 
to by a user on the touch panel; a pointing operation in 
the pointing device mode of operation for displaying a 
symbol indicative of a position pointed to on the display 
and for moving the symbol at a predetermined reduction 

10 scale factor on the display device in accordance with the 
distance, direction and velocity of the relative movement 
of the touch position pointed to by the user on the touch 
panel; and a display magnifying operation in the pointing 
device mode of operation for displaying an image in the 

15 neighborhood of the symbol in magnified form in a 
predetermined region within the touch panel. In the touch 
panel mode of operation, the CPU 102 may further perfojnu a 
further touch panel operation for displaying the symbol 
indicative of the position pointed to on the display so 

20 that the indicted position of the symbol is aligned with 
the position touched by the user on the touch panel. The 
CPU 10 may include some or all, in the form of hardware, 
of a mode switching operation section 1022, a touch panel 
operation section 1024, a pointing operation section 1026 

25 and a display magnifying operation section 1028, which 
correspond to the operations described above. 
[0031] FIGURES 2A and 2B show different arrangements 

of the display device 128 and the transparent touch panel 
138, which can be employed in embodiments of the 

30 invention. In FIGURE 2A, the touch panel 138 having the 
same size as the display device 128 is aligned with and 
overlaid on the display device 128. In FIGURE 2B, the 
touch panel 138 is placed in front of the display device 
128 so as to cover the display device 128 and a key area 

35 130 for marking. 

[0032] The apparatus 100 operates in either the 

pointing device mode of operation or the touch panel mode 



of operation in accordance with the position touched by a 
stylus pen on the touch panel 138, by switching the modes 
with a hardware or software switch. A finger may be used 
in stead of the stylus pen. The switching between the two 
5 modes can be made by the user. Alternatively, the 
switching between the two modes may be made automatically 
in accordance with predetermined conditions. 
[0033] FIGURES 3A and 3B show an embodiment of the 

information processing apparatus 100 in accordance with 

10 the invention. 

[0034] FIGURE 3A shows the indicated position of a 

cursor or pointer 206 in a form of a mouse arrow pointer 
as an example on the display device 128, in the touch 
panel mode of operation. The cursor or pointer 128 

15 includes known cursor or pointer symbols, such as a cross 
pointer, an I-beam pointer, a link pointer and a grabber 
hand. A graphic symbol 210 indicates that the apparatus 
100 is operating in the touch panel mode of operation. 
The graphic symbol 210 may not be displayed. While the 

20 apparatus 100 is operating in the touch panel mode of 
operation, when the user manipulates the stylus pen 208 on 
the touch panel 202 to touch the touch panel 202 at a 
particular position, the CPU 102 (the touch panel 
operation section 1024) moves the cursor 206 on the touch 

25 panel 2 02 to the particular position touched with the 
stylus pen 208, to perform an input operation in 
accordance with the operation of the stylus pen. However, 
the cursor 206 may not be displayed in the touch panel 
mode of operation. 

30 [0035] FIGURE 3B shows the indicated position of the 

cursor or pointer 206 on the display device 128 in the 
pointing device mode of operation. The presence of a 
pointing area 214 displayed in a predetermined region 
within a display area 204 indicates that the information 

35 processing apparatus 100 is operating in the pointing 
device mode of operation, while the absence of the area 
214 as shown in FIGURE 3A indicates that it is operating 
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in the touch panel mode of operation. Further, . a graphic 
symbol 212 mimicking the appearance of a mouse may be 
displayed to signify that the information processing 
apparatus 100 is operating in the pointing device mode of 
5 operation. A display image within a predetermined range 
in the neighborhood of the cursor 206 on the touch panel 
202 is also displayed in the pointing area 214, in a 
magnified form at a predetermined magnification scale 
factor, and the cursor 220 displayed in the area 214 that 

10 corresponds to the cursor 206 displayed in the display 
area 204 always lies at the center of the area 214. While 
the information processing apparatus 100 is operating in 
the pointing device mode of operation, when the user 
manipulates the stylus pen 208 on the touch panel 202 to 

15 touch the touch panel 202 at a particular position within 
the pointing area 214 and move within the area 214, the 
CPU 102 (the pointing operation section 1026) moves the 
cursor 206 currently positioned on the touch panel 202, in 
accordance with the relative movement of the stylus pen 

20 208 held in contact with the touch panel 202, and in the 
same direction as the pen movement, but at a rate equal to 
a predetermined reduction scale factor (i.e., at the 
reciprocal of the magnification scale factor) . 
[0036] The CPU 102 (the switching operation section 

25 1022) may switch between the touch panel mode of operation 
as shown in FIGURE 3A and the pointing device mode of 
operation as shown in FIGURE 3B, in response to tapping 
the touch panel 202 at the position of the graphic symbol 
210 or 212 by the user with the stylus pen 208. 

30 [0037] FIGURES 4A and 4B show a further display form 

in the pointing device mode of operation in FIGURE 3B. 
The image within the predetermined range in the 
neighborhood of the cursor 206 on the touch panel 202 is 
also displayed in the pointing area 218, in a magnified 

35 form at a predetermined magnification scale factor by the 
display magnifying operation section 1028, and the cursor 
220 displayed in the area 218, which corresponds to the 



cursor 206 displayed in the display area 204, is always 
positioned at the center of the area 218. In FIGURES 4A 
and 4B, when the stylus pen 208 is dragged within the area 
218, the cursor 20 6 moves accordingly, in a direction 
5 opposite to the direction of the movement of the stylus 
pen 208, and at a rate equal to the reciprocal of the 
magnification scale factor at which the relative movement 
of the stylus pen 208 is magnified. Thus the cursor 220 
in the area 218 does not move, but the display image in 

10 the neighborhood of the cursor 220 moves in the same 
direction as the pen movement. In other words, the cursor 
206 moves as if the display image in the neighborhood of 
the cursor 220 in the magnifying area 218 were grabbed 
with the stylus pen 208 functioning as a grabber. 

15 [0038] FIGURE 5 shows a flow chart for determining 

whether an input mode of operation should enter into the 
pointing device mode of operation or the touch panel mode 
of operation in response to the manipulation of the stylus 
pen 208, which is executed by the information processing 

20 apparatus 100, i.e. by the CPU 102 or the mode switching 
operation section 1022, in accordance with a program. 
[0039] At Step 302, the CPU 102 (the mode switching 

operation section 1022) acquires the current position of 
the stylus pen 208 on the touch panel 138. At Step 304, 

25 the CPU 102 (the switching operation section 1022) scans a 
region within a predetermined range in the neighborhood of 
the position of the stylus pen 208 on the touch panel 138. 
At Step 306, the CPU 102 (the switching operation section 
1022) determines whether two or more software keys or URL 

30 link indications, i.e., clickable objects, are contained 
within the region. If it is determined that such objects 
are contained, then the CPU 102 (the switching operation 
section 1022) at Step 308 causes the input mode of 
operation to enter into the pointing device mode of 

35 operation. This enables the user to move the cursor 206 
accurately to the position indicative of a desired key or 
URL link. If it is determined that two or more software 
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keys, URL links or like objects are not contained in the 
designated area, the CPU 102 (the switching operation 
section 1022) at Step 310 causes the input mode of 
operation to enter into the touch panel mode. This 
5 enables the user to instantaneously point to any desired 
position on the touch panel 138 with the stylus pen 208, 
[0040] FIGURE 6 shows a detailed flow chart 

illustrating the pointing device mode of operation at Step 
308 in FIGURE 5. 

10 [0041] At Step 322, the CPU 102 (the display 

magnifying operation section 1028) displays the cursor 206 
on the display device 128, and indicates that the current 
input mode of operation is the pointing device mode of 
operation, for example, by displaying the graphic symbol 

15 212 or the area 214. 

[0042] At Step 324, the CPU 102 (the pointing 

operation section 102 6) takes in the current position of 
the cursor 206 on the touch panel 138 in terms of 
coordinates pointed to as an input. At Step 326, the CPU 

20 102 (the pointing operation section 1026) determines 
whether the stylus pen 208 is manipulated or not, and 
whether the manipulation represents a drag operation or a 
tap operation. 

[0043] If it is determined that a drag operation is 

25 performed, the CPU 102 (the pointing operation section 
1026) at Step 328 determines the difference between the 
sets of coordinates representative of the relative 
movement of the stylus pen 208 on the touch panel 138 
caused by the drag operation, determines, in accordance 
30 with the difference, a two-dimensional distance (x, y) by 
which the cursor 206 is to be moved on the touch panel 138 
at a predetermined reduction scale factor, and moves the 
cursor 206 accordingly by that distance. At Step 330, the 
CPU 102 (the pointing operation section 1026) determines 
35 whether the drag operation is completed or not. If it is 
determined that the drag operation has not yet been 
completed, and is still continuing, the procedure returns 
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to step 328. If it is determined that the drag operation 
is completed, the procedure returns to Step 324. 
[0044] If, at Step 326, it is determined that a tap 

operation is performed, the CPU 102 (the pointing 
5 operation section 1026) determines at Step 342 whether the 
stylus pen 208 is subsequently manipulated continuously, 
and if it is manipulated continuously, then it determines 
whether the manipulation represents a tap operation or a 
drag operation. 

10 [0045] If it is determined at Step 342 that the 

stylus pen 208 is not subsequently operated, the CPU 102 
(the pointing operation section 1026) at Step 344 
determines that the manipulation represents a click 
operation, and processes it as an input accordingly. 

15 [0046] If it is determined at Step 342 that the 

stylus pen 208 is subsequently manipulated and that the 
manipulation represents a tap operation, then the CPU 102 
(the pointing operation section 102 6) at Step 34 6 
determines that the manipulation represents a double click 

20 operation, and processes it as an input accordingly. 

[0047] If it is determined at Step 342 that the 

stylus pen 2 08 is subsequently manipulated and that the 
manipulation represents a drag operation, the CPU 102 (the 
pointing operation section 102 6) at Step 348 determines 

25 the difference between the sets of coordinates 
representative of the relative movement of the stylus pen 
208 on the touch panel 138 caused by the drag operation, 
determines, in accordance with the difference, a two- 
dimensional distance (x, y) by which the cursor 206 is to 

30 be moved on the touch panel 138 at a predetermined 
reduction scale factor, and moves the cursor 206 
accordingly by that distance, to perform the drag 
operation corresponding to the movement. At Step 350, the 
CPU 102 (the pointing operation section 1026) determines 

35 whether the drag operation is completed or not. If it is 
determined that the drag operation has not yet been 
completed, the procedure returns to Step 328. If it is 
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determined that the drag operation is completed, the 
procedure returns to Step 324. 

[0048] FIGURE 7 shows a detailed flow chart 

illustrating the touch panel mode of operation at Step 310 
5 in FIGURE 5, 

[0049] At Step 362, the CPU 102 (the touch panel 

operation section 1024) displays the cursor 206 on the 
display device 128, and indicates that the current input 
mode of operation is the touch panel mode of operation, 
10 for example, by displaying the graphic symbol 210 or by 
not displaying the area 214. Alternatively, the cursor 
206 may not be displayed. 

[0050] At Step 364, the CPU 102 (the touch panel 

operation section 1024) determines whether the stylus pen 

15 208 is manipulated or not, and, if it is manipulated, then 
it determines whether the manipulation represents a tap 
operation, a double click operation or a drag operation. 
[0051] If it is determined at Step 364 that a single 

tap operation is performed with the stylus pen 208, the 

20 CPU 102 (the touch panel operation section 1024) at Step 
366 determines the position of the stylus pen 208 as 
coordinates pointed to and performs input processing for 
the click operation. After that, the procedure returns to 
Step 364. 

25 [0052] If it is determined at Step 364 that a double 

tap operation is performed with the stylus pen 208, the 
CPU 102 (the touch panel operation section 1024) at Step 
368 determines the position of the stylus pen 208 as 
coordinates pointed to and performs input processing for 

30 the double click operation. After that, the process 
returns to Step 364. 

[0053] If it is determined at Step 364 that a drag 

operation is performed with the stylus pen 2 08, the CPU 
102 (the pointing operation section 1026) at Step 370 
35 determines the position of the stylus pen 208 as 
coordinates pointed to and performs input processing for 
the drag operation. Thus the CPU 102 (the pointing 
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operation section 1026) moves the cursor 206 by a short 
distance in accordance with the start point coordinate 
position and the end point coordinate position of the 
stylus pen 208 in the drag operation on the touch panel 
5 138, to perform the processing accordingly. After that, 
the procedure returns to Step 364. 

[0054] FIGURE 8 shows another flow chart for 

automatically determining whether to operate in the 
pointing device mode of operation or the touch panel mode 

10 of operation in response to the manipulation of the stylus 
pen 208, which is executed by the information processing 
apparatus 100, i.e. by the CPU 102 or the mode switching 
processing section 1022, in accordance with a program. 
[0055] At Step 602, the CPU 102 (the switching 

15 operation section 1022) acquires the current position of 
the stylus pen 208 on the touch panel 138. At Step 604, 
the CPU 102 (the switching operation section 1022) 
determines whether the position lies within the area 214. 
If it is determined that the position lies within the area 

20 214, the procedure proceeds to Step 606 to enter into the 
pointing device mode of operation in FIGURE 6. If it is 
determined that the position does not lie within the area 
214, the procedure proceeds to Step 610 to enter into the 
touch panel mode of operation in FIGURE 7. After Step 60 6 

25 or 610, the procedure returns to Step 602. 

[0056] FIGURE 9 shows another flow chart which is 

executed by the CPU 102, simultaneously with the flow 
chart of the pointing device mode of operation of FIGURE 6 
which is represented by Step 308 in FIGURE 5. 

30 Alternatively, neither the mode of operation nor the area 
display may be changed during the drag operation. 
[0057] At Step 632, the CPU 102 (the pointing 

operation section 1026) determines whether the stylus pen 
208 is currently being dragged or not. If it is 

35 determined that the stylus pen 208 is not being dragged, 
only the Step 308 in FIGURE 5 is executed. 

[0058] If it is determined that the stylus pen 208 is 
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being dragged, then the CPU 102 (the pointing operation 
section 1026) at Step 634 determines whether or not the 
current position of the stylus pen 208 lies on a boundary 
216 of the area 214. If it is determined that the 
5 position does not lie on the boundary 216, the process 
returns to Step 632. 

[0059] If it is determined that the position lies on 

the boundary 216, the CPU 102 (the pointing operation 
section 1026) determines at Step 636 whether or not the 
10 current position of the stylus pen 208 lies outside the 
area 214. If it is determined that the position does not 
lie outside the boundary 216, the procedure returns to 
Step 634. 

[0060] If it is determined that the position lies 

15 outside the boundary 216, the CPU 102 (the display 
magnifying operation section 1028) at Step 638 moves the 
display position of the area 214 accordingly by a short 
distance so that the current position of the stylus pen 
208 lies on the boundary 216 of the area 214. FIGURE llA 

20 shows how the area 214 is moved in accordance with the 
flow chart of FIGURE 9. In FIGURE llA, dashed lines 
indicate the initial position of the area 214, and solid 
lines indicate the area 2142 after the movement. Upon 
completion of the dragging, the area may be moved back to 

25 its initial position. Alternatively, the CPU 102 (the 
display magnifying operation section 1028) may expand the 
display area 214 in the horizontal and/or vertical 
direction so that the current position of the stylus pen 
208 lies on the boundary 216 of the area 214. Upon 

30 completion of the dragging, the size of the area may be 
reduced to its initial size. FIGURE IIB shows how the 
area 214 is expanded in accordance with the flow chart of 
FIGURE 9. In FIGURE IIB, dashed lines indicate the 
initial position of the area 214, and solid lines indicate 

35 the area 2144 after the movement. 

[0061] FIGURE 10 shows another flow, chart which is 

executed by the CPU 102 or the display magnifying 
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operation section 1028, simultaneously with the flow chart 
of the touch panel mode of operation of FIGURE 7 which is 
represented by Step 310 in FIGURE 5. 

[0062] At Step 632, the CPU 102 (the display 

5 magnifying operation section 1028) determines whether the 
stylus pen 208 is currently being dragged or not. If it 
is determined that the stylus pen 208 is not being 
dragged, only the Step 310 in FIGURE 5 is executed • 
[0063] If it is determined that the stylus pen 208 is 

10 being dragged, then the CPU 102 (the display magnifying 
operation section 1028) at Step 634 determines whether or 
not the current position of the stylus pen 208 lies on the 
boundary 216 of the area 214. If it is determined that 
the position does not lie on the boundary 216, the 

15 procedure returns to Step 632. 

[0064] If it is determined that the stylus pen 208 

lies on the boundary 216, the CPU 102 (the display 
magnifying operation section 1028) at Step 638 moves the 
display position of the area 214 accordingly by a short 

20 distance so that the current position of the stylus pen 
208 moves outside the area 214. If the area 214 lies on 
either one of sides of the display area 204, the area 214 
may be cause to move or jump to the opposite side of the 
display area 204. FIGURE IIC shows how the area 214 is 

25 moved in accordance with the flow chart of FIGURE 10. In 
FIGURE lie, dashed lines indicate the initial position of 
the area 214, another set of dashed lines indicates the 
area 2146 being moved, and solid lines indicate the area 
2148 after the movement. 

30 [0065] FIGURE 12 shows an additional subroutine, 

incorporated into the flow chart of the pointing device 
mode of operation of FIGURE 6, for changing the 
magnification scale factor for magnified display within 
the area 214, which is executed by the CPU 102 (the 

35 display magnifying operation section 1028) . 

[0066] FIGURES 13A and 13B show a circular drag 

operation in the area 214 in connection with FIGURE 12. 
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[0067] After Step 328 in FIGURE 6, when the user, at 

Step 372 of FIGURE 12, performs the dragging operation 
with the stylus pen 208 in such a manner as to draw a 
circle around a center region C in the area 214 shown in 
5 FIGURE 13A, the CPU 102 (the pointing operation section 
1026) determines whether a circular drag is detected or 
not, by checking whether the locus 1102 of the stylus pen 
208 exhibits a 360 degree rotation in a polar coordinate 
system with its origin in the center region C and checking 

10 whether the locus 1102 crosses the center region 

However, the center region C is not required to be 
explicitly indicated on the display screen. Whether the 
locus 1102 of the stylus pen is closed in the polar 
coordinate system may be determined by detecting whether 

15 the locus 1102 of the stylus pen sequentially crosses all 
of the plurality of lines 1120 extending radially from the 
center not explicitly shown on the display screen. The 
plurality of lines 1120 may not explicitly displayed on 
the screen. 

20 [0068] If it is determined that a circular drag is 

detected, the CPU 102 (the display magnifying operation 
section 1028) at Step 374 changes the magnification scale 
factor for displaying. For example, when the locus 1102 
exhibits a full rotation in the clockwise direction, the 

25 magnification scale factor for displaying may be increased 
to 1.25 times the current magnification factor. On the 
other hand, when the locus 1102 exhibits a full rotation 
in the counterclockwise direction, for example, the 
magnification scale factor may be reduced to 0.75 times 

30 the current magnification factor. After that, the 
procedure proceeds to Step 330 in FIGURE 6. 
[0069] If it is determined that a circular drag is 

not detected, the process proceeds to step 330 in FIGURE 
6. 

35 [0070] In FIGURE 13B, if the locus 1108 is an 

incomplete rotation, i.e., if the locus 1108 does not 
cross all of the radially extending lines 1120 
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sequentially, or if it crosses the center region C, or if 
it crosses any one of the radially extending lines 1120 a 
plurality of times successively, then it is determined 
that a circular drag is not detected, and the procedure 
5 proceeds to Step 330 in FIGURE 6. 

[0071] The above-described embodiments are only 

typical examples, and their modifications and variations 
are apparent to those skilled in the art. It should be 
noted that those skilled in the art can make various 
10 modifications to the above-described embodiments without 
departing from the principle of the invention and the 
accompanying claims • 
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